Two-View Segmentation of Dynamic Scenes from the Multibody Fundamental Matrix
نویسندگان
چکیده
We present a geometric approach to 3D motion segmentation of multiple moving objects seen in two perspective views. Our approach is based on the multibody epipolar constraint and its associated multibody fundamental matrix, which are generalizations of the epipolar constraint and of the fundamental matrix to multiple moving objects. We show how to linearly solve for the multibody fundamental matrix and for the number of independent motions. We also show how the epipoles of each independent motion can be computed from the nullspace of the multibody fundamental matrix, while epipolar lines and fundamental matrices can be recovered using tensor factorization. Motion segmentation is then obtained from either the epipoles or the fundamental matrices. We demonstrate the proposed approach to segment a real image sequence.
منابع مشابه
Segmentation of Dynamic Scenes from the Multibody Fundamental Matrix∗
We present a geometric approach for the analysis of dynamic scenes containing multiple rigidly moving objects seen in two perspective views. Our approach exploits the algebraic and geometric properties of the so-called multibody epipolar constraint and its associated multibody fundamental matrix, which are natural generalizations of the epipolar constraint and of the fundamental matrix to multi...
متن کاملThe Space of Multibody Fundamental Matrices: Rank, Geometry and Projection
We study the rank and geometry of the multibody fundamental matrix, a geometric entity characterizing the two-view geometry of dynamic scenes consisting of multiple rigidbody motions. We derive an upper bound on the rank of the multibody fundamental matrix that depends on the number of independent translations. We also derive an algebraic characterization of the SVD of a multibody fundamental m...
متن کاملOptimal Segmentation of Dynamic Scenes from Two Perspective Views
We present a novel algorithm for optimally segmenting dynamic scenes containing multiple rigidly moving objects. We cast the motion segmentation problem as a constrained nonlinear least squares problem which minimizes the reprojection error subject to all multibody epipolar constraints. By converting this constrained problem into an unconstrained one, we obtain an objective function that depend...
متن کاملView Interpolation for Dynamic Scenes
This paper describes a novel technique for synthesizing a dynamic scene from two images without the use of a 3D model. A scene containing rigid or non-rigid objects, in which each object can move in any orientation or direction, is considered. It is shown that such a scene can be converted into several equivalent static scenes, where each scene only includes one rigid object. Our method can gen...
متن کاملConditions for Segmentation of Motion with Affine Fundamental Matrix
Various computer vision applications involve recovery and estimation of multiple motions from images of dynamic scenes. The exact nature of objects’ motions and the camera parameters are often not known a priori and therefore, the most general motion model (the fundamental matrix) is applied. Although the estimation of a fundamental matrix and its use for motion segmentation are well understood...
متن کامل